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(54) Abstract Title 

Data stream enhancement 

(57) Within a computer network, a client computer is attached to a server computer that is in turn attached to a 
data source computer. The client computer passes decoding parameter data to the server computer indicating 
the capabilities of the client computer and user preferences for the decoding of a data stream passed from the 
server computer to the client computer. When the client computer requests, 50, a data stream from the server 
computer, this will either be satisfied, 56, from a local data source or a remote data source computer and passed 
back to the client computer. Before this data stream is passed back to the client computer it is parsed, 58, to 
identify predetermined data items in accordance with the decoding parameters provided by the client computer 
and further data items are added, 60, to the data stream with a content dependent upon the content of the found 
predetermined data items. The network may be the Internet and the further items may be WAV or JPEG files, text 
translations or text highlighting. 
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DATA STREAM ENHANCEMENT 
This invention relates to the field of data processing. More particularly, this 
invention relates to data processing systems in which a client computer is connected 
to a server computer and issues a request to that server computer for a desired stream 
of data. 

It is known to provide client/server type data processing systems in which a 
client computer is connected to a server computer by a network link and the server 
computer serves to provide a stream of data desired by said client computer in 
response to a request from said client computer. An example of such a client server 
system is the internet. With the internet, a client computer may run browser software 
and is connected to a server computer that it itself connected into the internet. A data 
request is first sent from the client computer to its server computer. If the server 
computer can itself service that request, e.g. through web page caching, then the data 
is returned to the client computer from the server. More usually, the server computer 
does not have the requested data and itself issues a further data request to a remote 
data source, which could be anywhere in the world providing it is connected to the 
internet, and relies upon that data source to generate the required stream of data, 
which then passes back to the client computer via the server computer. 

A problem with the internet is that the data sources provide data in a relatively 
inflexible format that may not be well matched to the capabilities of the client 
computer or to the particular requirements of the individual user operating the client 
computer. 

Viewed from one aspect the present invention provides a data processing 
apparatus comprising: 

a client computer; 

a server computer connected to said client computer by a first computer 
network link, said server computer being operable to supply a stream of data to said 
client computer; and 

a data source connected to said server computer by a second computer link, 
said data source being responsive to a data request from said server computer to 
generate said stream of data that then passes via said server computer to said client 
computer; wherein 
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said server computer parses said stream of data and, in response to finding a 
predetermined data item within said data stream, adds a further data item to said data 
stream, content of said further data item being dependent content of said 
predetermined data item. 

The present invention recognises that whilst the data source may provide the 
stream of data to fulfil the client computer request, it is possible for the server 
computer to parse this stream of data before it passes to the client computer and add 
further data items to the stream of data so as to more closely match the capabilities 
of the client computer or the preferences of the user. This can be achieved without 
any changes being necessary in remote data sources as the additional functionality is 
provided by the client computer and the server to which the client computer attaches. 
This has the result that the enhanced functionality is available for all suitable data 
retrieved from remote sources without requiring any cooperation by the providers of 
these remote data sources. In addition, the server computer may typically be a 
comparatively powerful computer compared to the client computer and so better able 
to undertake the processing required to augment the basic stream of data in real time. 

Whilst the augmentation of the stream of data received by the server computer 
could be fixed for all client computers connected to that server, in preferred 
embodiments of the invention said server computer is responsive to client decoding 
parameters describing the capabilities of said client computer to decode said data 
stream for presentation to a user in determining which predetermined data items to 
parse for and which further data items to add. 

In this way, the server is able to provide increased functionality that is 
individually tailored to variable characteristics of client computers connected that 
server. An example might be an internet service provider to whom customers may 
connect with client computers having greatly varying capabilities. In this case, the 
client computers could send parameters to the server computer indicating to the server 
computer which types of data augmentation would be useful or desirable to them. In 
addition, user preferences could be sent from the client computer to the server 
computer. 

The data stream sent to the client computer could be the result of a request for 
that data stream by the client computer or it could be "pushed" down to the client 
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computer without a request, e.g. an automatic update. Preferably, said client 
computer issues a client data request to said server computer and said stream of data 
pasted from said data source via said server computer to said client computer fulfils 
said client data request. 

It will be appreciated that whilst the client computer, the server computer and 
the data source could form pan of many different types of data network, the invention 
is of particular utility in embodiments in which at least one of said first computer 
network link and said second computer link are internet links. 

In the context of a computer network, the server computer could take a 
number of forms including one of a proxy server computer, a router or a gateway 
computer. 

Whilst the data stream that is to be augmented by the server computer could 
have many different formats, a format that is particularly well suited to parsing and 
augmentation is that in which said data stream is a HTML document or an XML 
document. 

There are many possibilities for the nature of the augmentation of the stream 
of data that may be provided by the server computer. Preferred embodiments include 
ones in which: 

said client computer includes an audio data playing mechanism, said 
predetermined data item is text data and said further data item is audio data 
corresponding to a read version of said text data for use by said audio data 
playing mechanism; 

said client computer includes a voice recognition mechanism, said 
predetermined data item is a html link and said further data is voice pattern 
data for use by said voice recognition mechanism to trigger said html link; 

said client computer includes a JPEG image rendering mechanism, said 
predetermined data item is a GIF image file and said further data item is a 
JPEG image file constructed from said GIF image file for use by said JPEG 
image rendering mechanism; 

said predetermined data item is text data in a first language and said 
farther data item is a complete or partial translation of said text data into a 
second language; 
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said predetermined data item is text data and said further data item is 
highlighting within said text data of problem areas of at least one of spelling 
and grammar; and 

said predetermined data item is a graphics image of a first resolution 
and said further data item is an altered version of said graphics image with a 
second resolution that is different from said first resolution and constructed by 
image processing techniques. 

The technical and commercial advantages of the invention are particular strong 
in embodiments of the invention in which said server computer provides a point of 
presence to said client computer on the internet and said first network line is a dial 
up link. 

In this situation, the invention provides an internet service provider to offer 
an additional service to its users in a manner that distinguishes it from its competition 
who otherwise present a very uniform level of service. 

Viewed from another aspect the present invention provides a data processing 
method comprising the steps of: 

connecting a client computer to a server computer by a first computer network 

link; 

connecting said server computer to a data source by a second computer link; 
sending a data request for a stream of data from said server computer to said 
data source; 

generating with said data source said stream of data; 

sending said stream of data from said data source to said server computer to 
fulfil said data request; 

parsing said stream of data using said server computer and, in response to 
finding a predetermined data item within said data stream, adding a further data item 
to said data stream, content of said further data item being dependent content of said 
predetermined data item; and 

sending said stream of data including any further data item from said server 
computer to said client computer. 

It will be appreciated that with modern computer networks the different 
portions of the network may be positioned at great distances for one another and often 
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in different countries. In this situation, the entire system is never present within a 
single country with separate countries and jurisdictions containing only a portion of 
the system. 

Viewed from a complementary aspect, the present invention provides a server 
computer for connection to a client computer via a first computer network link and 
a data source by a second computer link, said server computer comprising: 

a data request transmitter for sending a data request to said data source to 
trigger said data source to generate a stream of data that then passes via said server 
computer to said client computer; and 

a data parsing mechanism that parses said stream of data and, in response to 
finding a predetermined data item within said data stream, adds a further data item 
to said data stream, content of said further data item being dependent content of said 
predetermined data item. 

Viewed from a further complementary aspect the present invention provides 
a client computer for connection via a first computer network link to a server 
computer, said server computer being connected via a second computer link to a data 
source, said client computer comprising: 

a client decoding parameters transmitter for sending to said server computer 
client decoding parameters describing the capabilities of said client computer to 
decode a data stream for presentation to a user so as to control said server computer 
to parse said data stream for predetermined data items, said data stream being 
generated by said data source and passed to said client computer via said .server 
computer, and, in response to finding said predetermined data items within said data 
stream, add a further data items to said data stream, content of said further data items 
being dependent content of said predetermined data items. 

An embodiment of the invention will now be described, by way of example 
only, with reference to the accompanying drawings in which: 

Figure 1 illustrates a computer network system; 

Figure 2 schematically illustrates a client computer; 

Figure 3 schematically illustrates a server computer; 

Figure 4 schematically illustrates a data source computer; 

Figure 5 is a flow diagram illustrating the process when a client connects to 
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a server; and 

Figure 6 is a flow diagram illustrating the process when a client requests data. 
Figure 1 schematically illustrates client server based computer network. The 
client computer 2 is based in Edinburgh. The server computer 4 is placed in London. 
The client computer 2 is linked to the server computer 4 via a first computer network 
link having the form of a dial up modem link 6. 

For a particular data request issued by the client computer 2, the server 
computer 4 identifies the data sources as being a data source computer 8 that is 
located on the west coast of the USA. The server computer 4 issues a second data 
request to the data source computer 8 via a dedicated high capacity second computer 
network link 10. The data source computer 8 responds to the received data request 
to generate the required data stream and this is then passed back to the server 
computer 4 (possibly by a different route). The server computer 4 then parses this 
data stream to identify predetermined data items, adds further data items in response 
to the content of the predetermined data items and then' passing an augmented data 
stream back to the client computer 2, This parsing is best done by monitoring the 
data and adding to it as it is passed to the client computer 2 rather than first collecting 
the whole content of the data stream, e.g. the full file being passed. 

It will be seen from this example, that whilst the client computer 2 and the 
server computer 4 are in the same country, the data source computer 8 is in a 
completely different country. Further, there is no technical reason why the client 
computer need not be in a different country to the server computer. 

Figure 2 schematically illustrates a client computer 2. The client computer 
comprises a central processing unit 12, a random access memory 14 and a storage 
disc 16 wich an associated disc controller 18. In order to communicate with the 
server computer 4, the client computer 2 includes a modem 20 that is coupled to a 
dial up telephone line 22, Output to a user is provided on a monitor 24 that is driven 
by a display driver 26 and via a loud speaker 28 that is driven by a sound card 30. 
User input to the client computer 2 is provided via a keyboard 32, a mouse 34 and 
a microphone 36 that is coupled to the sound card 30 via which voice recognition 
capability is provided. The client computer can be a personal computer. (It will be 
appreciated that other client computers, such as a thin network computer could be 



02/20/2004, EAST version: 1.4.1 



used instead of a PC and that the modem link could be replaced with another form 
of network link). The disc storage 16 contains computer program files and data files 
which are loaded into the random access memory 14 and then used to control the 
central processing unit 12 to perform its various operations. The program files on 
the disc storage include an internet browser program that allows the client computer 
2 to make a dial up modem connection with an internet server computer 4 and then 
interact with that server computer 4 via user inputs made with the keyboard 32 and 
mouse 34 whilst presenting the received data stream from the server computer to the 
user via the display monitor 24 and the speaker 28. 

The client computer 2 illustrated in Figure 2 includes an audio data playing 
mechanism in the form of the sound card 30 and the loud speaker 28. In this case, 
it is possible for the server computer to augment the data stream being passed to this 
client computer with audio data, e.g. a WAV file, corresponding to a spoken version 
of text data within the data stream. Such text to audio conversion is highly processor 
intensive and so the superior capabilities of the server computer 4 can be used to 
undertake this processing with the user requiring a comparatively low powered client 
computer 2 to interpret this augmented data stream. 

It is also known to provide personal computers with voice recognition 
capabilities. Such capabilities are provided by an appropriate computer program 
executing on the central processing unit 12 upon data received via a microphone 36 
and a sound card 30. The data received via the microphone 36 is compared with 
known voice pattern data corresponding to certain phrases or commands in order to 
identify a match. The generation of this voice pattern data for comparison with the 
data received by the microphone 36 is a processor intensive operation. Accordingly, 
the server computer 4 can be used to parse the data stream for html links and can 
then generate voice pattern data for that link that may be spoken by a user. This 
voice pattern data can be passed to the client computer 2 where it may be used by the 
central processing unit 12 to match voice inputs of the user to trigger the taking of 
the corresponding html link. 

In the context of image data to be displayed on the display monitor 24, the 
present invention can be utilised to match to the particular data formats supported by 
a client computer. For example, if the client computer incorporates a JPEG image 
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rendering mechanism, then embedded GIF image files within the data stream can be 
supplemented by JPEG image files. An alternative would be when a client computer 
has better image display performance than is expected by the data source computer 
8. In this case, the data source computer 8 may provide a relatively low resolution 
image. The server computer 4. knowing from the data decoding parameters of the 
client computer 2 that the client computer has a superior image data resolution can 
perform image enhancement on the data received from the data source computer 8 
prior to passing it to the client computer 2 so as to take better advantage of the 
capabilities of the client computer 2. 

In other circumstances, it may be appropriate for the server computer 4 to 
augment the data by providing a machine translation using one of the commercially 
available machine translation programs of received text data from a first language to 
a second language. This is particularly useful in non-English language speaking 
countries to overcome the problem that the vast majority of information on the 
internet is published in English. It may also be appropriate for the server computer 
to use one of the commercially available spell checking or grammar checking 
programs to add highlighting data to problem areas within received text data. 

Figure 3 illustrates a server computer 4. The server computer 4 can be 
broken down into comparable portions to that of the client computer 2. In practice, 
the server computer 4 is likely to be a powerful mainframe computer and the differem 
portions will typically have a much higher capacity and specification than the 
equivalent portions of the client computer 2. Additional parts of the server computer 
4 are a modem bank 38 and a network router 40. The modem bank 38 is responsible 
for receiving dial up telephone links from a plurality of client computers. The 
network router 40 provides high capacity TCP/IP links to other computers on the 
internet. 

When the server computer 4 receives a request for a stream of data from the 
client computer 2, such as a request for a new web page, the server computer 4 
attempts to see if it can satisfy that request locally, e.g. through web page caching, 
and if it is able to, then links to the local data source for that stream of data. If the 
stream of data is not present locally, then a network connection via the network router 
40 is sought to the remote data source computer 8 that is able to satisfy that request 



02/20/2004, EAST Version: 1.4.1 



of the client computer 2. This part of the operation of the server computer 4 is 
known in the field of internet computers. 

Figure 4 schematically illustrates a data source computer 8. The portions of 
this are the same as for the server computer 4 except that the data source computer 
8 need not have a modem bank 38. 

The client computer 2 and the server computer 4 are modified in their 
operation compared to known equivalent computers operating on the internet. Figure 
5 is a flow diagram illustrating the process when a client computer 2 firstcoirects 
via a dial up link to the server computer 4. At step 42 the client computer 2 sends 
the server computer 4 its user identifier (userid) and associated password. At step 44, 
the server computer 4 authenticates the user identifier and the password and if they 
pass the authentication, then connects the client computer to the internet. At step 46, 
the client computer 2 sends the server computer 4 decoding parameter information for 
the client computer 2. (The decoding parameter information could be sent to the 
server computer 4 by another mechanism). This information would include, for 
example, details of whether or not the client computer 2 included a sound card 30 and 
loud speaker 28 for reproducing audio files, a microphone 36, sound card 30 and 
appropriate software for undertaking voice recognition, graphics handling capabilities 
and other parameters of the client computer. The decoding parameters could also 
include user preferences, such as whether or not the user wants a translation of 
incoming text data to be added to the data stream by the server computer 4 or 
whether problem areas of spelling or grammar should be highlighted within incoming 
text data. At step 48, the server computer 4 logs these decoding parameters for the 
particular client computer 2 so that it may act upon them by appropriately parsing the 
data stream to be passed to the client computer 2 and adding the desired further data 
items to that data stream. 

Figure 6 is a flow diagram schematically illustrating the client computer 2 
accessing a data stream via the server computer 4. At step 50, the user takes some 
action by manipulating the keyboard 32 or mouse 34 of the client computer 2 to 
trigger a first data request to be issued from the client computer 2 to the server 
computer 4 via the dial up network link 6. The user action could, for example, be 
activating the mouse 34 over a hypertext link pointing to a new internet web page. 
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Alternatively, if a data "push" operation was being performed, then step 50 would be 
omitted. 

At step 52, the server computer 4 determines whether or not it has the 
requested information stored locally. If the information is stored locally, then a link 
to that local data source, such as disc storage 16 or random access memory 14, is 
made. Alternatively, if the requested data stream cannot be provided locally, then 
the server computer 4 makes an access to a remote data source computer 8 at step 54. 

At step 56, the server computer has recovered the requested data stream and 
then makes reference to the stored decoding parameters for the client computer 2 that 
requested that data stream in order to determine which predetermined data items to 
parse for within the data stream. At step 58, the server computer 4 parses the data 
for the predetermined data items as indicated by the decoding parameters. 

If predetermined data items are found, then at step 60, additional data items 
whose content depends upon the predetermined data items found are added to the data 
stream. 

The further data items added to the data stream could take a number of 
different forms. One example would be an audio file corresponding to a read version 
of text data within the data stream. Conventional text to audio conversion 
mechanisms could be used by the server computer to achieve this. The client 
computer 2 would require an audio data playing mechanism, such as the sound card 
30 and loud speaker 38, in order to reproduce the added audio data file. If the client 
computer 2 had a voice recognition capability by virtue of appropriate software and 
hardware on the client computer 2, then the server computer 4 could be used to add 
voice pattern data to the data stream corresponding to HTML links or XML links 
found within the data stream. This voice pattern data would then be used by the 
voice recognition mechanism within the client computer 2 to match with input voice 
commands from any user. If the client computer includes a JPEG image rendering 
mechanism in the form of appropriate hardware or software. In this case, the server 
computer 4 can scan for GIF image files within the data streams and add 
corresponding JPEG image files. With regard to text data within the data stream, the 
vast majority of text data on the internet is in English. This can be a problem for a 
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person whose first language is not English. In this case, known machines translation 
programmes could be used by the server computer 4 to add a translation into a 
different language of text data within the data stream as indicated by user preferences 
to form part of the decoding parameters. In a similar way, it might in some 
ctrcumstances be desirable for the server computer 4 to add highlighting data to text 
data within the data stream indicating problem areas with the spelling or grammar of 
that text data. Known spelling and grammar testing software, such as is present in 
many word processing programs, could be used by the server computer 4 to achieve 
this. A further example of added data would be in the case where the client computer 
2 had a higher graphics capability that the data stream graphics had been intended for 
In this case, the server computer 4 can execute image enhancement software using a 
variety of image enhancement algorithms as desired in order to produce an added 
graphics image representing an enhanced version of the original graphics image. 

At step 62, the client computer receives the data stream from the server 
computer 4 and displays or interprets it to the user according to its decoding abilities. 

Whilst the above has been described in terms of the internet computer 
network, it will be appreciated that the invention could be utilised on other computer 
networks. Similarly, the particular choice of hardware or software for carrying out 
the parsing of the data stream and the adding of additional data items could be varied 
to suit the particular circumstances and desired aims and would be appreciated by the 
skilled man in the field. 
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CLAIMS 



1. A data processing apparatus comprising: 
a client computer; 

5 a server computer connected to said client computer by a first computer 

network link, said server computer being operable to supply a stream of data to said 
client computer; and 

a data source connected to said server computer by a second computer link, 
said data source being responsive to a data request from said server computer to 
10 generate said stream of data that then passes via said server computer to said client 
computer; wherein 

said server computer parses said stream of data and, in response to finding a 
predetermined data item within said data stream, adds a further data item to said data 
stream, content of said further data item being dependent content of said 
15 predetermined data item. 

2. A data processing apparatus as claimed in claim 1, wherein said server 
computer is responsive to client decoding parameters describing the capabilities of 
said client computer to decode said data stream for presentation to a user in 

20 determining which predetermined data items to parse for and which further data items 
to add. 

3. A data processing apparatus as claimed in any one of claim 1 or 2, wherein 
said client computer issues a client data request to said server computer and said 

25 stream of data pasted from said data source via said server computer to said client 
computer fulfils said client data request. 

4. A data processing apparatus as claimed in any one of claims 1, 2 or 3, 
wherein at least one of said first computer network link and said second computer 

30 link are internet links. 

5. A data processing apparatus as claimed in any one of the preceding claims, 
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wherein said server computer is one of a proxy server computer, a router or a 
gateway computer. 

6. A data processing apparatus as claimed in any one of the preceding claims, 
wherein said data stream is a HTML document or an XML document. 

7. A data processing apparatus as claimed in any one of the preceding claims, 
wherein said client computer includes an audio data playing mechanism, said 
predetermined data item is text data and said further data item is audio data 
corresponding to a spoken version of said text data for use by said audio data playing 
mechanism. 

8. A data processing apparatus as claimed in any one of the preceding claims, 
wherein said client computer includes a voice recognition mechanism, said 
predetermined data item is a HTML link or an XML link and said further data is 
voice pattern data for use by said voice recognition mechanism to trigger said HTML 
link or said XML link. 

9. A data processing apparatus as claimed in any one of the preceding claims, 
wherein said client computer includes a JPEG image rendering mechanism, said 
predetermined data item is a GIF image file and said further data item is a JPEG 
image file constructed from said GIF image file for use by said JPEG "image 
rendering mechanism. 

10. A data processing apparatus as claimed in any preceding claim, wherein said 
predetermined data item is text data in a first language and said further data item is 
a complete or partial translation of said text data into a second language. 

11. A data processing apparatus as claimed in any one of the preceding claims, 
wherein said predetermined data item is text data and said further data item is 
highlighting within said text data of problem areas of at least one of spelling and 
grammar. 
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12. A data processing apparatus as claimed in any one of the preceding claims, 
wherein said predetermined data item is a graphics image of a first resolution and said 
further data item is an altered version of said graphics image with a second resolution 
that is different from said first resolution and constructed by image progressing 
techniques. 

13. A data processing apparatus as claimed in any one of the preceding claims, 
wherein said server computer provides a point of presence to said client computer on 
the internet. 



14. A data processing apparatus as claimed in any preceding claim, wherein said 
first network line is a dial up link. 

15. A data processing method comprising the steps of; 

connecting a client computer to a server computer by a first computer network 

link; 

connecting said server computer to a data source by a second computer link; 
sending a data request for a stream of data from said server computer to said 
data source; 

generating with said data source said stream of data; 

sending said stream of data from said data source to said server computer to 
fulfil said data request; 

parsing said stream of data using said server computer and, in response to 
finding a predetermined data item within said data stream, adding a further data item 
to said data stream, content of said further data item being dependent content of said 
predetermined data item; and 

sending said stream of data including any further data item from said server 
computer to said client computer. 

16. A server computer for connection to a client computer via a first computer 
network link and a data source by a second computer link, said server computer 
comprising: 
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a data request transmitter for sending a data request to said data source to 
trigger said data source to generate a stream of data that then passes via said server 
computer to said client computer; and 

a data parsing mechanism that parses said stream of data and, in response to 
finding a predetermined data item within said data stream, adds a further data item 
to said data stream, content of said further data item being dependent content of said 
predetermined data item. 



17. A client computer for connection via a first computer network link to a server 

computer, said server computer being connected via a second computer link to a data 

source, said client computer comprising: 

a client decoding parameters transmitter for sending to said server computer 

client decoding parameters describing the capabilities of said client computer to 
decode a data stream for presentation to a user so as to control said server computer 
to parse said data stream for predetermined data items, said data stream being 
generated by said data source and passed to said client computer via said server 
computer, and, in response to finding said predetermined data items within said data 
stream, add a further data items to said data stream, content of said further data items 
being dependent content of said predetermined data items. 

18. A data processing apparatus substantially as hereinbefore described with 
reference to the accompanying drawings. 

19. A data processing method substantially as hereinbefore described with 
reference to the accompanying drawings. 



02/20/2004, EAST version: 1.4.1 




Application No: 
Claims searched: 



GB 9721794.7 
1-19 



Raent 
Office 

lb 



Examiner: 
Date of search: 



Geoffrey Western 
23 April 1998 



Patents Act 1977 

Search Report under Section 17 

Databases searched: 



UK Patent Office collections, including GB, EP, WO & US patent specifications, in: 
UKCl(Ed.P): G4AAFGXAUDB 
Int CI (Ed. 6): G06F 13/38 17/30 
Other: On-line : COMPUTER, INSPEC, WPI 



Categoiy 


Identity of document and relevant passage 


Relevant to 
claims 


X 


EP 0778534 Al (SUN MICROSYSTEMS) 


N.b. pages 5-7 


1,3-6,13-16 


X 


EP 0773503 A2 (TOSHIBA) 


N.b. columns 9-12 


1,3,4,13-16 


X 


EP 0718783 Al (SUN MICROSYSTEMS) 


N.b. pages 3-5 


1,3,4,6,13-16 



X Document indicating lack of novelty or inventive step 
Y Document indicating lack of inventive step if combined 
with one or more other documents of same category. 

& Member of the same patent family 



A Document indicating technological background and/or state of the art. 
P Document published on or after the declared priority dale but before 

the filing date of this invention. 
E Patent document published on or after, but with priority date earlier 

than, the filing date of this application. 



An Executive Agency of the Department of Trade and Industry 
02/20/2004, EAST Version: 1.4.1 



